On learning strategies for evolutionary Monte Carlo
نویسندگان
چکیده
The real-parameter evolutionary Monte Carlo algorithm (EMC) has been proposed as an effective tool both for sampling from high-dimensional distributions and for stochastic optimization (Liang and Wong, 2001). EMC uses a temperature ladder similar to that in parallel tempering (PT; Geyer, 1991). In contrast with PT, EMC allows for crossover moves between parallel and tempered MCMC chains. In the context of EMC, we introduce four new moves, which enhance its efficiency as measured by the effective sample size. Secondly, we introduce a practical strategy for determining the temperature range and placing the temperatures in the ladder used in EMC and PT. Lastly, we prove the validity of the conditional sampling step of the snooker algorithm, a crossover move in EMC, which extends a result of Roberts and Gilks (1994).
منابع مشابه
Ph D in Computer Games and Artificial Intelligence
The field of study of the PhD position offered is Computer Games (CG) and Artificial Intelligence (AI) in general. More precisely the games studied are zero-sum two-player complete information games with a high complexity such as Go, Amazons or Shogi. In addition to Tree Search (TS) and knowledge-based techniques, the technique newly used in the computer Go community is Monte-Carlo (MC) [5]. Th...
متن کاملAn Adaptive Scheme for Real Function Optimization Acting as a Selection Operator
We propose an adaptive scheme for real function optimization whose dynamics is driven by selection. The method is parametric and relies explicitly on the Gaussian density seen as an infinite search population. We define two gradient flows acting on the density parameters, in the spirit of neural network learning rules, which maximize either the function expectation relatively to the density or ...
متن کاملCo-evolution of agent strategies in N-player dilemmas
Understanding how cooperative behaviour emerges within a population of individuals has been the focus of a great deal of research in the multi-agent systems community. In this paper, we examine the effectiveness of two different learning mechanisms – an evolutionary-based technique and a social imitation technique – in promoting and maintaining cooperation in the spatial N-player Iterated Priso...
متن کاملA Version of Geiringer-like Theorem for Decision Making in the Environments with Randomness and Incomplete Information
Purpose – The purpose of this paper is to establish a version of a theorem that originated from population genetics and has been later adopted in evolutionary computation theory that will lead to novel Monte-Carlo sampling algorithms that provably increase the AI potential. Design/methodology/approach – In the current paper the authors set up a mathematical framework, state and prove a version ...
متن کاملA Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
Redundant and irrelevant features in high dimensional data increase the complexity in underlying mathematical models. It is necessary to conduct pre-processing steps that search for the most relevant features in order to reduce the dimensionality of the data. This study made use of a meta-heuristic search approach which uses lightweight random simulations to balance between the exploitation of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Statistics and Computing
دوره 17 شماره
صفحات -
تاریخ انتشار 2007